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INTRODUCTION 

With  the  recent  MANPRINT  initiative  on  development  and  evaluation  of  Army 
systems,  continued  interest  exists  in  the  relationship  between  system/soldier 
performance,  training  proficiency  and  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  scores.  During  1986  and  early  1987,  under  the  auspices  of  the 
Operational  Test  and  Evaluation  Agency  (OTEA) ,  a  Follow-on  Test  and  Evaluation 
(FOT&E)  of  the  AN/TRC-170  tactical  troposcatter  systems  was  conducted.  The 
AN/TRC-170  is  a  family  of  three  multichannel  radio  terminal  sets  (V1-V3)  that 
were  developed  by  Raytheon  under  contract  to  the  Electronic  Systems  Division  of 
the  United  States  Air  Force.  In  order  to  evaluate  the  suitability  of  the  V2 
and  V3  systems  for.  Army  missions,  the  FOT&E  was  conducted.  Since  four  Block 
test  training  proficiency  measures,  system  performance  (time)  measures 
(obtained  during  the  FOT&E)  and  ASVAB  scores  were  available,  it  seemed 
appropriate  to  address  the  relationship  among  these  variables.  Differences  in 
the  demographic  characteristics  of  the  FOT&E  and  non-FOT&E  soldiers  in  the 
target  audience  are  summarized  In  Appendix  A.  Aptitude  (ASVAB)  differences 
between  FOT&E  and  non-FOT&E  soldiers  are  summarized  in  Appendix  B.  Finally  in 
Appendix  C,  comparability  of  teams  formed  for  conduct  of  the  FOT&E  is  accessed 
via  training  achievement  proficiency  and  ASVAB  Composites  performance. 

METHOD 

Dependent  Variable 

In  preparation  for  the  FOT&E,  27  critical  tasks  were  identified  in 
conjunction  with  set— up  and  operation  of  the  V2,  and  12  critical  tasks  were 
noted  for  the  V3  operations.  Many  of  the  tasks  associated  with  V2  and  V3  are 
comparable  and  require  similar  task  steps.  When  results  for  comparable  tasks 
are  combined,  a  total  of  19  different  tasks  can  be  identified.  The  basic  data 
(dependent  variable)  used  in  exploring  the  relationship  among  these  variables 
(task  performance,  training  achievement  and  aptitude)  is  task  performance  time. 
Over  the  entire  FOT&E,  performance  time  data  was  collected  on  1449  occasions. 
Index  variable  Jh  is  used  to  define  the  occasion,  i.e.,  h=l,1449. 

Independent  Variables 

Through  coordination  with  Keesler  AFB,  where  Additional  Skill  Identifier 
(ASI)D6  training  was  conducted,  and  ARl  Headquarters,  both  training  achievement 
scores  and  ASVAB  measures  were  obtained.  Index  variable  g  is  used  to  define 
the  predictor  variable;  £=1,32.  Training  achievement  measures  were  obtained  on 
each  of  the  first  four  blocks  of  training  for  all  thirty-five  MOS  26Q  FOT&E 
Operators.  Each  block  test  was  composed  of  twenty-five  multiple  choice  items. 
Data  for  16  ASVAB  Subtests  and  11  Scaled  Scores  is  less  complete,  especially 
for  Subtests;  data  exists  primarily  for  10  Subtests.  Part  of  this 
incompleteness  is  due  to  the  fact  that  soldiers  entering  the  service  at 
different  times  have  been  administered  different  versions  of  the  ASVAB;  with 
subsequent  versions,  some  Subtests  have  been  deleted  and  new  ones  added.  As 
indicated  earlier,  another  reason  for  incompleteness  seems  to  be  due  to  a 
decision  outside  ARI,  in  some  cases,  to  purge  soldiers  ASVAB  Subtest  scores 
once  the  Area  Composites  have  been  computed.  If  applied  research  in  the  real 
world  is  to  be  conducted,  such  occurrences  must  be  met  with  the  attitude  to  do 
the  best  you  can  with  what  you  have." 
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Method  of  Analysis 


With  a  large  number  of  variables,  one  methodology  frequently  used  to  better 
understand  what  relationships  exist  is  the  Pearson  correlation  •  It  Is  well 
understood  in  research  that  relationships  between  predicted  (dependent)  and 
predictor  (independent)  variables  are  greater  when  there  is  high  comparability 
between  the  measurement  conditions  and  the  content  of  items  used  to  obtain  both 
sets  of  measures.  For  this  reason,  stronger  relationships  were  expected 
between  performance  time  and  training  achievement  than  between  performance  and 
aptitude.  The  purpose  of  the  analyses  described  was  to  find  the  procedure  which 
demonstrates  the  best  relationship  possible  between  predicted  and  predictor 
variables.  In  general  terms  the  methodology  employed  moved  from:  (1) 
Considering  cases  which  show  the  relationship  between  Individual  predictor 
variables  and  task  performance  time  to  (2)  finding  the  best  relationship 
between  combinations  of  predictor  variables  and  performance  time  using  stepwise 
regression. 

Individual  Predictor/Performance  Time  Relationships 


In  order  to  understand  the  procedure  employed,  it  is  Important  first  to 
highlight  the  fact  that  for  the  19  different  critical  tasks  identified  for  data 
collection,  most  of  these  tasks  were  performed  by  one  to  four  Operators  on 
different  occasions;  hence  the  question  arises  how  to  relate  one  performance 
measure  (time)  to  the  training  achievement  or  aptitude  of  one,  two,  three  or 
four  soldiers  performing  the  task.  Answering  this  question  in  effect  leads  to 
consideration  of  appropriate  transformations  of  the  basic  set  of  independent 
predictor  variables  described  above. 

Independent  (Predictor)  Variable  Definition.  Among  the  procedures  used  for 
defining  the  independent  (predictor)  variables  X  for  the  _gth  predictor^(e.g. , 
block  test  training  score,  ASVAB  Subtest  or  Composite  score)  on  the  hi^ 
occasion,  general  definitions  appear  immediately  below  followed  by  specific 
Case  definitions: 

2 

General  Definition  Condition 


X 


Vlg'ci 


task  performed  by  one 
soldier  (i)  on  occasion  h 


task  performed  by  two 
soldiers  (i,j)  on  occasion]^ 


^Generally  the  Pearson  correlation  is  computed  for  independent  pairs  of 
interval  or  ratio  scale  observations.  In  the  correlations  computed  throughout, 
only  the  performance  times  (dependent  variable)  were  strictly  '^independent" ; 
depending  on  the  soldier  performing  each  task,  the  same  predictor  (independent 
variable)  was  used. 

^One  MOS  29M  and  one  26Q  not  assigned  as  team  Operator  on  occasion  assisted  in 
completion  of  tasks;  as  their  ASVAB  data  (and  for  the  26Q,  Block  Test  scores) 
were  available,  analyses  included  data  for  these  soldiers  on  occasions  in  which 
they  contributed  to  task  completion. 
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Condition  (cont.) 


General  Definition  (cont.) 


Xgh  ■  (•i''ig-^^j’'3g+*‘k’‘kg+”m’‘mg>44 


task  performed  by  three 
soldiers  (l,j,k)  on  occasion  _h 

task  performed  by  four 
soldiers  (i,j,k,m)  on 
occasion  h 


With  this  general  definition,  four  specific  cases  for  defining  constants  c^, 
C2  ,  and  c^,  and  weights  a^,  a^,  aj^,  and  a^^^  were  employed: 

Case  1  ajj^=aj=aj^=a^=  1  and  Cj^=l,  C2=2,  0^=3  and  c^=4 

(Equal  Weighted  Mean) 


Case  2 

(Equal  Weighted  Sum) 
Case  3 

(Differential  Soldier 
Weighted  Sum) 


a^=a  •“aj^=aj^=  1  for  all  cases 

i, j,k,m=l,"'37  but  Ifjkktm  and  Cj^=C2=C3=c^=l 

for  aj^,aj,aj^,aj^, where  i,  3,  k,  m  =  1,  37  but  i7^j?fk?^m 
and  generally  a^i/»a aj^fa^j^  and  02^=02=03=0^=! 


Case  4 

(Differential  Score 
Weighted  Sum) 


i,j,k,m=l,37  but  ikj4kkm  and  when  jg~^kg“^rag 

=a  .=ai  =a„  and  Ci  =09=00=04=! .  Generally 


then  a^ 


-  ''I  -li 

any  scores  x  which  had  the  same  value  were  assigned 
the  same  weight  regardless  which  soldier  scored  that 
value . 


Case  1  simply  involved  averaging  the  scores  for  the  predictor  variable  under 
consideration  for  all  soldiers  who  participated  in  the  task  on  an  occasion  hi. 

In  this  case,  performance  time  is  assumed  to  be  related  to  the  average 
predictor  variable  score  for  soldiers  who  performed  the  task  without  regard  for 
the  variability  in  those  scores.  In  Case  2,  the  predictor  variable  scores  for 
each  participating  soldier  were  summed ,  In  this  case,  performance  is  assumed 
to  be  a  direct  function  of  predictor  scores  of  participating  soldiers  and  the 
variability  in  those  scores.  This  procedure  assumes  that  each  soldier's 
contribution  to  the  performance  time  for  a  task  is  directly  proportional  to  the 
particular  value  of  the  predictor  variable  (^)  •  Case  3  requires  assigning  a 
different  weight  for  each  soldier  on  those  tasks  on  which  he/she  participated. 
In  this  case,  the  assumption  is  made  that  each  soldier  has  a  unique 
contribution  to  task  completion  which  is  a  function  of  the  predictor  variable 
(g)  under  consideration  and  that  performance  time  is  related  to  the  weighted 
sum  of  predictor  scores.  For  Case  4  a  different  weight  is  assigned  for  each 
predictor  value  of  a  predictor  (g).  For  this  procedure  it  is  assumed  that  each 
predictor  value  is  not  directly  proportional  to  its  magnitude  in  predicting 
performance;  however,  the  unique  contributions  of  any  specific  predictor  value 
is  the  same  regardless  which  soldier  obtained  that  value. 

Each  of  these  procedures  has  potential  strengths  and  weaknesses.  The  first 
two  procedures  are  simple  to  use  and  parsimonious  in  terms  of  estimation 
requirements  but  have  less  hope  of  demonstrating  a  relationship  between 


3 


performance  and  predictor.  The  first  case  which  involves  averaging  is  a 
commonly  accepted  way  of  obtaining  a  single  predictor  measure  from  several 
individuals  to  correlate  with  a  single  performance  measure;  however,  compared 
with  the  second  case  in  which  the  predictor  measures  are  summed,  the  range  of 
possible  predictor  values  is  smaller.  Since  the  magnitude  of  the  correlation 
between  two  sets  of  measures  can  be  a  function  of  the  variability  of  scores, 
Case  1  would  be  expected  to  produce  smaller  correlational  values.  The  third  is 
generally  the  least  parsimonious  of  the  three  procedures  because  individual 
weights  must  be  estimated  for  each  soldier;  furthermore,  since  weights  obtained 
are  for  specific  soldiers,  they  are  useful  only  for  demonstrating  the 
relationship  between  performance  and  aptitude/ training  level  for  these  specific 
soldiers.  However,  since  "fit" — all  other  things  being  equal  is  generally  a 
direct  function  of  the  number  of  "fitting"  parameters,  (of  the  four)  this 
procedure  would  be  expected  to  demonstrate  the  maximum  relationship  that  exists 
between  task  performance  time  and  aptitude/ training  level.  The  fourth 
procedure  is  intermediate  in  parsimony  and,  because  the  differential  weighting 
is  score  related,  weights  obtained  have  potential  value  for  predicting  task 
performance  for  other  members  of  the  MOS  26Q  population  .  Another  way  of 
viewing  these  procedures  for  defining  individual  predictor  variable  values  is 
as  a  multiple  correlation  procedure  where  soldiers  and  scores,  (cases  3  and  4) 
respectively,  are  the  Independent  variables. 

Conventional  Transformations.  Before  the  set  of  correlations  for  each  case 
were  computed,  the  efficacy  of  more  conventional  transformations  for  Case  2 
(Equal  weighting)  was  explored  for  Total  ASI  Block  Score  and  the  ASVAB  ST 
Composite  scale.  The  set  of  transformations  explored  is  presented  in  Table  1. 
Correlation  for  each  of  these  cases  served  as  a  basis  for  deciding  what  type  of 
transformed  data,  if  any,  would  be  used  in  subsequent  analyses. 


Table  1 

Transformations  of  Predictor  and  Performance  Time  Used  to  Explore  the  Best  Form 
of  Variables  to  Demonstrate  a  Linear  Relationship 


P 

R 

E 

D 

I 

C 

T 

0 

R 


Performance  Time 


Raw 


LOG, 


LOG 


10 


SQRT 


ARSIN 


Raw 


LOG^ 


LOG  10 
SQRT 


Note  1.  Performed  for  Total  Block  Training  Score  and  ASVAB  ST  Composite  Score. 


^Development  of  a  performance  prediction  model(s)  would  be  appropriate  only  for 
validated  relationships.  This  was  beyond  the  scope  of  the  current  effort. 


4 


In  order  to  compute  the  ARCSIN  transformation  of  performance  time,  time  to 
complete  each  task  was  first  divided  by  the  maximum  time  ever  taken  to 
complete  that  task.  For  both  sample  predictors  used,  correlations  were  highest 
for  ’’Raw"  (untransformed)  data.  Consequently  all  subsequent  analyses  utilized 
"raw"  data. 

Removal  of  Outliers.  In  order  to  further  refine  the  data  prior  to 
correlational  analyses,  performance  times  which  were  clearly  ’’outliers  were 
deleted  from  the  data.  Since  the  data  collectors  did  not  always  record 
non~task  related  events  such  as  beginning  a  task  then  eating  or  sleeping  before 
its  completion,  the  deletion  is  reasoned  but  admittedly  based  solely  on  the 
absolute  value  of. the  deviant  (outlying)  recorded  time. 

Multiple  Predictor/Performance  Time  Relationships 

A  logical  extension  of  attempting  to  demonstrate  relationships  with  single 
predictor  variables  and  performance  is  to  explore  the  efficacy  of  using 
multiple  predictors.  With  N  as  sample  size  and  K  the  number  of  weights 
estimated,  Herzberg  (1969)  Indicated  that  for  stability  of  multiple 
correlations,  the  N/K  ratio  should  be  about  20,  i.e.,  there  should  be 
approximately  20  observations  per  weight  .  Since  the  number  of  observations 
available  for  analysis  drops  sharply  when  considering  individual  tasks,  any 
differential  weighting  by  soldier,  score  or  predictor  creates  problems  in 
obtaining  relatively  stable  weights.  Accordingly  the  work  reported  here 
focuses  on  use  of  multiple  predictors  for  all  tasks  with  unweighted  summed 
predictors  and  with  differentially  score  weighted  summed  predictors  (scores  as 
defined  by  Cases  2  and  4).  All  multiple  predictor  analyses  presented  were 
performed  with  SAS  using  the  PROC  STEPWISE  procedure  with  the  MODEL  option 
MINR.  As  recommended  in  the  SAS  manual  for  this  procedure,  the  model  selected 
in  each  case  involved  those  set  of  predictor  variables  when  the  Cp  statistic  ^ 
first  approached  p  (the  number  of  weights  estimated — excluding  the  intercept). 


'^See  Herzberg,  P.A.  The  parameters  of  cross-validation.  Psychometrlka 
Monograph  Supplement ,  1969,  No.  16. 

^Mallow's  criterion  for  selection  of  a  "best"  multiple  correlation  relationship 
involves  selecting  the  model  with  the  predictor  variables  which  first  lead  the 
Cp  statistic  to  approach  £  (the  number  of  weights  estimated,  excluding  the 
intercept).  See  SAS  User's  Guide:  Statistics,  Version  5,  pp.  765-766  for  more 
detailed  discussion. 
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RESULTS  AND  DISCUSSION 


Correlations  Between  Averaged  Individual  Predictors  and  Performance  Time 

Table  2  shows  correlations  between  performance  times  and  average 
training/ASVAB  Composite  Scores  for  each  of  19  different  tasks  and  over  all 
tasks~uncorrec ted  and  where  possible  corrected  for  unreliability  of  the 
criterion”.  This  table  also  indicates  the  number  of  measurement  occasions  h, 
and  the  F  statistic  to  assess  statistical  significance  of  the  uncorrected 
correlations.  Of  these  19  tasks,  only  EXTERNAL  SHELTER  SET~UP,  INTERNAL 
SHELTER  SET-UP  and  KLYSTRON  ADJUSTMENT  were  covered  in  the  first  four  training 
blocks  for  which  training  achievement  scores  exist.  Most  of  the  other  tasks 
(if  they  were  covered  during  formal  ASl  training)  were  covered  in  Block  5  for 
which  only  a  GO/NO  GO  criterion  was  used.  In  as  much  as  only  these  three  tasks 
were  trained  in  the  first  four  blocks,  it  is  reasonable  to  presume  that  the 
significant  correlations  between  training  achievement  block  scores  and  other 
tasks  are  probably  spurious.  With  this  rational  analysis  it  would  appear  that 
only  the  correlation  between  Block  3  training  and  Klystron  Adjustment 
performance  times  was  truly  significant  [F^  (1,69)  =  10.14,  jp  <.01]. 

Of  the  220  correlations  Involving  ASVAB  averaged  Composites  and 
performance  time  (by  task  and  all  tasks  combined),  29  were  statistically 
significant.  Since  20  of  those  significant  correlations  were  obtained  for 
three  tasks“INSTALL  AZ/EL  ASSEMBLY,  ATTACH  FLEXIBLE  WAVE  GUIDES  and  EXTERNAL 
SHELTER  SET-UP,  it  is  conjectured  that  characteristics  of  performance  times 
distribution  for  these  tasks  played  a  large  part  in  the  obtained  correlations. 
The  causal  relationship  (if  any)  between  the  specific  ASVAB  Composites  and 
performance  times  is  unclear.  Replication  of  these  correlations  for  randomly 
formed  halves  would  provide  added  support  for  the  validity  of  the  obtained 
relationships.  However,  the  relatively  low  reliabilities  of  the  performance 
measure  makes  analyses  directed  at  the  validity  of  relationships  seemingly 
unproductive.  For  some  cases,  when  such  replication  efforts  would  be  based  on 
rather  small  random  sample  sizes,  results  would  probably  lack  stability. 


^Where  estimates  of  reliability  were  non-negative  and  the  square  root  of  the 
reliability  estimate  was  less  than  the  uncorrected  correlation  between 
predictor  and  criterion,  correlations  were  corrected  for  attenuation  using  the 
formula,  r  =r  l^f^  where  r  is  the  uncorrected  correlation  between  predictor 
and  criterion^^ariables  and  r^^  is  the  reliability  estimate  for  individual  task 
performance  times  or  all  tasks  combined. 
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lgiilfle«m;e  Test#  lor  Uiioe  I  glited  L'orreUtloiis  Using  Csse  I — Average  Bloik  Teat  Training  Scnrea  and  ASVAU  Area  CoiB|malte  Scorea 


TASK 

ULOCK  1 

BLOCK  2 

BLOCK  3 

BLOCK  4 

BLOCKS 

1-4  AFtjT 

m 

CM 

CL 

GT 

EL 

SC 

ST 

OF 

All 

(.U15) 

R  U.U06 

R  .0^9 

N  1359. 

F  0.05 

0.025 

.204 

1  359. 
0.05 

-.025 

-.204 

1359. 

0.65 

-.031 

-.253 

1  359  . 
1.31 

-.008 
-.06  5 

1  359. 
0.09 

-.054 

-.441 

1154. 

3.37 

-.06/ 

-.54/ 

1154. 

5.19^ 

-.05/ 

-.465 

1154. 

3./6 

-.033 
-.2  69 
1155. 
1.26 

-.026 

-.212 

1154. 

0.70. 

-.072 

-.588 

1154. 

6.00*^ 

-.059 

-.482 

1154, 

4.02® 

-.051 

-.416 

1154. 

3.00 

-.040 

-.37/ 

1154. 

1.85 

-  .01  6 

-.131 

1154. 

0.29 

-.O/.r, 

-.3/6 

1154. 

2 . 44 

Azimuth 
Stake-'out 
(  .0^6) 

R  -.0^4 
R,,-.20  5 
n"'  52, 

P  O.IO 

-.168 

-,;b3 

52. 

1.45 

-.100 

-.503 

52. 

0.59 

-.163 

-.760 

52. 

1.36 

-.152 

-.709 

52. 

1.18 

-.039 

-.182 

41  , 
0.06 

-.090 
-.420 
41  . 
0,32 

-.119 
-.555 
41  . 
0.56 

-.030 
-.  140 

41  . 

U .  04 

.019 

.089 

4  1  . 
0.01 

-.04  2 
-.196 
41. 
0.0/ 

-.051 

-.738 

41  , 

0.  10 

,011 

.051 

41  . 

0.00 

,041 

.191 

4]  . 

0.0/ 

- .  04  6 

-.714 

4  1  . 
O.UH 

-.til 

-.518 

4  1  . 
0.49 

Anteiiua 
tiuee  ^  LPA 
Stakeout 
(-.015) 

R  0.296 

"07241 

'0.295 

0.122 

“T)34o 

0.  ibX" 

1^6 

-.013 

-.059 

-.140 

-.056 

.051 

-.115 

-.110 

-.  0  57» 

.  tl 8 

N  IB. 

F  1.54 

16. 

1 .00 

18. 

1.53 

18, 

,  1.85 

18. 

2.09 

14. 

0.42 

14, 

0.26 

14. 

0 . 00 

14. 

0.04 

14. 

0.24 

14. 

0,04 

14. 

0.03 

14. 

0.  16 

14. 

0.15 

14. 

U.  14 

14  . 
U.Ul 

Remove 

Trauwi t 

Frame 

(-.031) 

K  0.143 

0. 106 

'  0.269 

■"OTIBZ 

0.2)6 

0.138 

0.0/2 

0.153 

0.103 

0.116 

(i.d  36 

0.0/6 

U.TZ.D 

0 . 0  i  u 

0 . 2l  3 

N  41. 

F  0.81 

41. 

0,44 

41. 

3.04 

41. 

1.41 

41. 

1.91 

35. 

0.64 

35. 

o.i; 

35. 

0.79 

35. 

0.35 

35. 

0,45 

35. 

0.04 

35. 

0.19 

35. 

0.48 

35. 

0,00 

35. 

1.57 

3  5 . 

0,23 

Triias 

k  -.063 

-.02  2 
-.492 

39. 

0.02 

7756 

To  18 
.402 

39. 

O.Ol 

7o39 

.072 

39, 

0.06 

7---— 

.1/9 

33. 

0.00 

708  2'"' 

-j-j-y' 

.42  5 
33. 
0.01 

^06H~ 

n7rr“ 

r;  nf)  3" 
-.06/ 

^,TjTd~ 

.224 

.  1  52 

.055 

.2  52 

.31  1 

Aflaeiuhiy 
Hemova 1 

(e002) 

N  39. 

F  0.15 

39. 

0.92 

33. 

0.21 

33. 

0.14 

33. 

0.92 

33. 

0.00 

33. 

0.00 

33. 

0.73 

33. 

0.09 

33. 
201  . 

31  . 

0.01 

I  natal  1 

R  0.358 

"07311 

7382 

-.158 

-.601 

13. 

0.28 

.338 

.004 

.015 

1  1  . 
O.OU 

TokV' 

.324 

1 1  . 
0.07 

-.0/5 

-.286 

11. 

0.05 

:74i~ 

.925 

1  1  . 
0.56 

"^04T" 

-.167 

”^354“ 

“^7276” 

-.060 

-.114 
-.4  34 

-.044 

-.168 

,043 
,  1  64 

•  *3  2  7 
.084 

Antenna 

Ancliors 

(.069) 

N  13. 

F  1.62 

13. 

1.19 

13. 

1.88 

n. 

1.42 

11. 

0.02 

1 1 . 

1.29 

11  . 
0.40 

11  . 
0.12 

11. 

0.02 

11  . 
0.02 

1  1  . 
0.(8* 

t  k  1  f 

Off  Load 

Pallet 

(.092) 

H  0.  109 
H.,  .359 
n"'  54. 

F  0.63 

~276 

-.890 

54. 

4.09® 

"O7O0O 

.264 

54. 

0.33 

~^2T? 

-.781 

54. 

3.09 

-.118 

-.389 

54. 

0.73 

0.019 

.063 

42. 

O.Oi 

■"oj')/  7“ 

.254 

42. 

0.24 

"'0T04T 

.  1  50 
42  . 
0.09 

■"oTu47"~ 
.  142 
42. 
0.0/ 

6.07/ 

.254 

42. 

0.24 

""080“ 

.264 

42. 

0.26 

"o7d56~“ 

.185 

42. 

0.13 

”07720 

.196 

42. 

0.58 

0.075 

.082 

42. 

0.03 

0.051 

.168 

4  2  . 

0. 10 

» 1  h 

.05 1 

42. 

0.01 

Baae  Plate 

I  natal la- 
t  Ion 
(.099) 

R  0.165 
IL,  .524 

n"'  81. 

F  2.21 

0.122 

.388 

81. 

1.19 

0.144 

.458 

01  . 
1.67 

0.00/ 

.022 

01. 

0.00 

0.157 

.499 

81 . 
2.00 

0.094 

.299 

68. 

0.59 

U.U40 

.17/ 

68  . 
O.ll 

0.048 

.152 

68. 

0.15 

0 . 090 
.206 
68. 
0.54 

-.036 

-.114 

68. 

0.09 

-.050 

-.159 

68, 

0.17 

0.002 

.006 

68. 

0.00 

-.047 

149 

68. 

0.15 

-.01 0 
-.032 

68  . 

0.01 

0.062 

.197 

6B. 

0.25 

,2/2 
6M  . 

0.  32 

Secure 

Antenna 

I.ega 

(-.010) 

K  U.2IU 
R^, 

N  83. 

F  3.74 

0.046 

83. 

0.17 

0. 100 

83. 

0.82 

0.  109 

83. 

0.97 

~0.]39 

83. 

1.60 

o.uhT” 

70. 

0.52 

-.0  18 

70. 

0.  10 

u.o44 

70. 
0.  13 

y)Ml] 

;u. 

0.05 

0.027" 

10. 

0.05 

- .  667 

70. 

0 . 00 

6.03? 

70. 

0.  10 

6 .  o46 

70. 

o.ll 

-.02  3 

70. 

0.04 

6.093 

70. 

0.59 

(f  .0  Or 

70. 

0.08 

J  n  a  t  a  i  I 
AZ/FX 
Aaeeuibly 
(.08/) 

"R~7y4  3“ 
R^-.146 

N  83. 

F  0.15 

-.003 

-.010 

83. 

0.00 

^-.131 

-.444 

83. 

1.41 

-.172 

-.583 

83. 

2.47 

-.105 

-.356 

63. 

0.90 

0.194 

.658 

69. 

2.62 

6.269 

.912 

69. 

5.23® 

U.21 2 
.719 
69. 
3.15 

6.248 

.841 

69. 

4.39® 

6,281 

.953 

69. 

5./4t’ 

0.76  2 
.888 
69. 
4.94® 

0.  T59 

.539 

69. 

1.74 

6. 266 

.902 

69. 

5.10® 

6.2  54 
.861 

69. 

4.62® 

0 ,  19* 
.658 
69. 
2.62 

.610 

6V. 

2.24 

T  n  a  t  a  1 1 

R  oTdIv" 

"023“" 

-.153 

-.178 

-.081 

0.166 

■6.235 

0.108 

6.2/6 

0.24  2 

6.134 

6.677“ 

0.  i7o 

0.265 

0.  152 

0.197 

Rp  .084 

.067 

-.444 

-.516 

-.235 

.401 

.681 

.313 

.  600 

.702 

.388 

.223 

.493 

.  760 

,441 

.5/1 

MOB 

c 

N  61  . 

81 . 

01  . 

61. 

Hi  . 

68. 

60. 

68. 

66, 

68. 

60. 

68. 

68, 

68. 

f>  H . 

ft  M  . 

(.119) 

F  0.0; 

0.04 

1.89 

2.58 

0.52 

1.8/ 

3.86 

0.78 

5.44'^ 

4.11® 

1.21 

0.39 

1.96 

4.98® 

1 .  56 

2 . 6f» 

Install 

H  -.134 

-.243 

-.183 

-.184 

-.243 

-.104 

-.06  2 

■77193" 

~\V* 

"039” 

“6”.  6  9  r 

"7;dB2” 

"TToI" 

“77(1  s  2 

”7.  ]  5  ft"” 

7,219 

Up  1)6  r 

Rp-.372 

-.6/4 

-.508 

-.510 

-.6/4 

-.455 

-.172 

-.535 

-.47/ 

-.100 

.252 

-.227 

-.064 

-,144 

-.433 

— .  bf  •  / 

Pedals 

8^. 

05. 

85. 

85. 

85. 

69. 

69. 

69. 

69, 

69. 

69. 

69. 

69. 

69  . 

69 . 

6^  . 

(.130) 

F  1.52 

5.21® 

2.8B 

2. 91 

5.21® 

1.05 

0.26 

2.59 

1.63 

0.10 

0,56 

0.45 

0.04 

(3.  10 

1.67 

3  .  18 

r  tifl  t  a  1  1 

R  0.029 

"096 

""o7ol3“ 

^05~ 

0.044 

d7dcm” 

“772  4  ~ 

"Tr'Tofi 

“7149" 

“771  5  8“ 

“TTfon 

■77 61 2" 

-  _  /ihM 

Ko 11  Yoke 

Rp  ,076 

,250 

.006 

-.146 

.115 

.021 

-.64  2 

-.485 

-.282 

-.389 

-.394 

.013 

-.412 

-.133 

- ,  CJ8  1 

-.021 

Struts 

C 

H  85. 

85. 

65. 

85. 

85. 

72. 

17, 

72. 

72. 

72. 

12. 

72. 

72. 

72. 

77  . 

7?  . 

(.14?) 

F  0.0/ 

0.77 

0.09 

0.76 

0.16 

O.OU 

4.51® 

2.51 

0.H3 

1.59 

1,63 

0,00 

1.79 

0.  IB 

0.07 

0 . 00 

Attach 

R  -.184 

"oTdel 

-.090 

""01~ 

-.0/0 

-.255 

”7;  4  61“ 

"7,28" 

'7 .745“ 

~7;^T5'" 

- .  36  4 

-.17  0 

- ,  1  5  1 

Flexible 

Kp-.j/e 

.125 

-.104 

.065 

-.143 

-.522 

-.624 

-.452 

-.591 

-.501 

-.587 

-.440 

-.745 

-.489 

-.34  0 

-  .  3' ’ 9 

Wavegvi  Idea 

115. 

115. 

115. 

U5. 

115. 

94. 

94. 

94. 

94. 

K 

94  , 

94  . 

94  . 

94  , 

94 . 

94  . 

(.239) 

F  3.96® 

0.42 

0,92 

0.12 

0.56 

6.40*' 

17.04^ 

4.72® 

0.38*^ 

5.8/*^ 

8.26*^ 

4.46® 

14.05’^ 

5.57^ 

2.74 

2.15 
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lubli!  i  caitC 

.IkhUIcimich  '{Mitcii  tor  UiiwuIhIiHhI  t;«»rr»i  J  «t  Itinii  tiuiiiM  »:hh«i  1 


llltrck  T«*Ht  rit'InlMrt  ftrpii'n  nn«l  ASVAH  Arrw 


lAbK 

hl.UCK  1 

BLOCK 

2  BLOCK  3 

lU.OCK  4 

BLOCKS  1-4 

£A 

HM 

UM 

CL 

C2 

EL 

SC 

SI 

U1 

t  tftinn 

R  -.11U9 

-.032 

-.033 

-.115 

-.056 

-.056 

-.166 

-.069 

1  3H 

-t)H3 . 

o.fHte 

-.001 

-,*iH3 

-.**55 

~  ,  (  OlO 

-  .  *'».  * 

ec  1 1 
C-.OUV) 

He  — 

N  6^. 

F  O.Ol 

64. 

O.UB 

64. 

0.09 

64. 

I.IU 

64. 

0.26 

73. 

0.24 

73. 

2.60 

7  3. 
0.34 

73, 

1.38 

73, 

0.49 

73. 

0 . 00 

73. 

0 . 00 

73. 

0.49 

T  073 — 

73. 

0.22 

71. 

0,46 

7  3. 

n.  20 

or’ 

l.vk 

K  O.HB 

“uTOaf 

-.014 

"=7045 

0.06  5 

-.048 

-  .0  76 

-.053 

-.006 

-.o  )1 

- .  1*6  7 

i:r  **C  t 

C-.ou) 

He 

N  53. 

F  0.99 

53. 

0,34 

53. 

0.01 

53. 

0. 10 

53. 

0.22 

46. 

O.U 

46. 

0.2/ 

46, 

0.13 

4H  . 

U .  OU 

4H. 

0.05 

40  . 

0.35 

- 1  7  d  " 

46. 

(*.33 

-.466 

54, 
0.9  7 

—  57,  — 

40. 

0.25 

r  17.7” 

40  . 

0.27 

-  197,' 

4H  . 

0.(*7 

~ .  FT 

4  >'  . 

(*  .  01 

,  i  (,/, 

iKl  e  mill 

3 ho  1  ter 

5e  C -up 
;.U8A) 

li  U,h*i3 

Kp  ,U8 

N  65. 

F  0.12 

u-uaT 

.2/9 

65. 

0.42 

u.in 
.363  * 

65. 
0./9 

0.0H2 
,263 
•  65. 
0.43 

0.0.32 
.  1  U) 

65. 

0.06 

-.192 

-.662 

54. 

1.99 

-.447 

54. 

12.98^ 

-.2  70 

-.932 

54. 

4,09" 

- .  3ufi 

54 , 
5.37* 

* ,  7  i  6 
-.745 
54. 
2.54 

-.9"’9 

54. 

4.36" 

- 37.7. 

54  . 
fl.(*9’- 

'r;'|rf7| 

-.076 

54  . 

2  .(*6 

-.417 
54  . 

n.  77 

-  .  5  ’  1 

5  4  , 

1.4/ 

™ ,  i  u  * 

1  lUecnni 

R  -.0^.0 
Ke-n9 

-.404 

-.140 

-.363 

~2o7 

-.536 

”^99 

-.516 

— -y-j-- 

-.567 
71  . 
3.48 

-.161 

71  . 
0.2  7 

~.'I65  ■ 
-.471 

7 1  . 

0  .  1  7 

.04  4 

7 1  . 

-  .04  4 

-.1  14 

7)  . 

-  .  2  '*  4 

-.632 

71  . 

-.60  7 

71  . 

-.269 

71. 

-.744 
71  . 

-.2  20 
7)  . 

- .  4 :» 7 

7  1  . 

Set-Up 

N  73. 

F  U.15 

73. 

1.// 

73. 

1.42 

73. 

3.16 

7  3 . 

2.93 

2.36 

0.02 

0.13 

—  m  Q — 

4,37" 

.  1 4  4” 

5.  2  l" 

0.7  5 

*) .  6  2 

uii  s  ~ 

0 . 50 

1  .  HM 

r  .  j  5  : 

K  J  yet  run 

”0.024’" 

”i>92" 

-.181 

”356 

-.213 

”■'1  hfi" 

112' 

^ .  0o7« 

-.019 

Ad  Jup  twent 
(-.020) 

Re 

N  /I. 

F  O.OU 

71  . 
0.59 

;i. 

.2.34 

71. 

10.  14*^ 

71. 

3.26 

67. 

1  .89 

67. 

0.03 

67. 

0.03 

67. 

0 . 00 

67  . 

0.U2 

“  rr  1 

67, 

I  .64 

II  1  1  3 1 1 

67. 

2.49 

'0.OM& 

.060 

57. 

0 . 00 

67. 

0.12 

'o.’VlTi — 

67  . 
0.4  7 

0 .  ''9  3 

67  . 
0,12 

0.06  6 

6/  . 
(3.9H 

~  ,  H  1,  ] 

All  t  ei>iia 

“o/F 

070 06 

”009 

~U7  7 

”0.050 

0.05& 

0  ]  S  ’ 

U .  1  34 

0 .  12  4 

U  •  ^ '  4  V 

,200 

52. 

0.02 

.9  0> 

.660 

-.4  )o 

MiKuwenC  R, 
(.010) 

"'n  60. 

F  0.29 

-./lu 

60, 

0.29 

,060 

60. 

0.00 

-.090 

OO. 

0.5/ 

-.770 

60, 

0,35 

.560 

52. 

0.1/ 

.560 

52, 

0.1/ 

-.160 

52. 

0,02 

52. 

0.91 

57. 

0.  7H 

52. 

0.91 

57. 

0,44 

57. 

0.7  2 

5  7 

0.09 

Note  1.  F  =  ^/[(l-r^)/(n-2)]  ,  on  1,  n-2  degrees  of  freedom  was  used  to  test  tlie 

significance  of  each  of  these  correlations.  See  McNemar,  Q.  Fs^c^logtcal  StaJ^^lj^ 
John  Wiley  and  Sons,  Inc  (3rd  Edition),  pp.  138,  2/h.  In  the  Table,  superscripts  a  = 
p<.05,  b  =  p<.025  and  c  =  p<.01. 

Note  2.  Estimate  of  criterion  performance  reliability  was  obtained  using  an  analys  s 
of  variance  approach  described  by  Myers,  J.  L.  Fundamentals  of  EJtperifflgntal_peslgn ! 
Allyn  and  Bacon,  Boston,  1967,  pp.  294-299.  Shelters  was  used  as  the  measure  of 
Between  Subjects  variance  and  the  residual — shelters  by  measurement  occasion 
interaction — the  Within  Subjects  variance.  Because  of  design  non-orthogonality.  Type 
III  Sum  of  Squares  produced  by  PROC  GLM  of  SAS  were  used. 

Note  3.  R  is  the  correlation  between  predictor  and  criterion  variables  corrected  for 
attenuation  due  to  unreliability  of  the  criterion  variable.  In  cases  where  the 
reliability  estimate  was  negative  or  tite  square  root  of  the  reliability  estimate  was 
less  than  the  correlation  between  predictor  and  criterion  variables,  no  attenuation 
adjustment  was  possible. 


Correlations  Between  Summed  Individual  Training  Achievement  Predictors  and 
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Performance  Time 

Table  3  shows  correlations  for  Cases  2-4  between  performance  time  and 
summed  Training  Achievement  scores  (equal  and  differentially  weighted).  The 
remaining  analyses  conducted  utilized  summed  predictor  scores  for  all  soldiers 
participating  in  a  task  rather  than  averaged  predictor  scores.  Such  a 
procedure  tends  to  Increase  the  range  of  values  available  for  correlation-a 
circumstance  which  can  lead  to  increases  in  the  magnitude  of  the  correlation 
obtained.  Based  on  review  of  results  presented  in  Table  3,  it  is  noted  that 
most  of  the  correlations  (unweighted  and  weighted)  are  significantly  different 
from  zero  although  relatively  low  in  absolute  value  (all  less  than  .21).  Only 
for  Blocks  3  and  4  does  differential  weighting  lead  to  significantly  larger 
correlations.  Comparing  the  unweighted  correlations  using  averages  of 
predictors  for  all  soldiers  participating  for  all  tasks  (See  Table  2)  with 
comparable  correlations  using  summed  predictors  (See  Table  3)  indicates  that 
the  latter  values  are  markedly  higher.  No  statistical  tests  for  significance 
were  performed  for  these  differences.  The  relatively  low  value  of  these 
correlations  in  both  cases  is  again  probably  due  to  the  fact  that  the  training 
achievement  scores  used  were  for  the  most  part  not  measures  of  tasks  whose 
performance  was  measured  during  the  FOT&E. 

Correlations  Between  Summed  Individual  ASVAB  Subtest  Predictors  and  Performance 
Time 

Table  4  shows  correlations  for  Cases  2—4  between  performance  time  and 
summed  ASVAB  Subtest  scores  (equal  and  differentially  weighted).  Most  of  the 
unweighted  correlations  obtained  are  not  significantly  different  from  zero.  For 
all  but  one  case  (where  sufficient  data  existed),  correlations  based  on  differ¬ 
entially  weighted  score  (soldier  or  score)  were  significantly  different  from 
zero.  The  magnitude  of  correlations  based  on  differentially  weighted  scores 
Involving  ASVAB  Subtests  were  larger  than  any  of  the  correlations  (uncorrected 
for  attenuation)  reported  in  Table  2  for  Training  Achievement  data. 

Correlations  Between  Summed  Individual  ASVAB  Composite  Predictors  and 
Performance  Time 

Table  5  shows  correlations  for  Cases  2-4  between  performance  times  and 
summed  ASVAB  Composite  scores  (equal  and  differentially  weighted).  In  this 
table  all  correlations  are  significantly  different  from  zero.  In  all  cases 
differential  weighting  (by  soldier  or  score)  leads  to  significantly  larger 
correlations  between  ASVAB  Composite  and  performance  time.  Score  weighting 
over  no  weighting  leads  to  significantly  larger  correlations  for  the  AFQT,  CO, 
CL,  GT,  EL,  SC  and  OF  Composites.  Soldier  weighting  over  score  weighting  leads 
to  significant  improvements  in  correlations  for  the  FA,  MM,  GM,  GT,  SC,  ST  and 
OF  Composites. 

^If  desired,  correlations  between  summed  unweighted  individual  predictors  and 
the  criterion  for  all  tasks  could  be  corrected  for  attenuation  using 
reliability  estimate  r^^=.015.  Generally,  differentially  weighted  predictor 
variable  correlations  exceed  the  reliability  estimate  for  all  tasks;  therefore 
no  correction  for  attenuation  was  meaningful. 
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Table  3 


Pearson  Type  Correlations  Using  Unweighted  and  Differential  Weights  for  Summed 
Individual  Soldier  Training  Achievement  Scores  and  Performance  Times  for  All 
Tasks  ,  , 


Block  1  1 
(8=1)  1 

Block  2  1 
(8=2)  1 

Block  3  1 
(8=3)  1 

Block  4  1 
(8=4)  i 

All  Blocks 

(g=5) 

r  (unweighted) 

r 

.086^  1 
(£<.005)1 

1 

.089®  1 

(£<.005)1 

1 

.078®  1 

(£<.005) i 

1 

.082®  1 
(£<.005)  i 

.085® 

(£<.005) 

R  (different 

weights 

each  soldier) 

1 

1 

.196®  1 

(£<.05)  I 

1 

1 

.177®  1 

(£>.05)  1 

.208^’  1 
(£<.001)1 

.197®^  1 
(£<.025)1 

.143® 

■(£>.05) 

weights  estimated  (K) 

36  1 

i 

1 

36  1 

1 

36  1 

1 

36  1 

1 

36 

R  (different 
weights 
each  score) 

1 

1 

.123®  1 

(£<.025)  1 

1 

.117®  1 

(£<.01)  1 

.128®^  1 
(£<•01 )  1 

.130^  1 

(£<.001)1 

.163® 

(£<.01) 

weights  estimated  (K) 

9  1 

I 

1 

7  1 

1 

9  1 

1 

7  1 

1 

18 

n 

1359  1 

1359  1 

1359  i 

1359  1 

1359 

Note  1.  See  NoJ^e  1,  ^^able  2 

Note  2.  F  =  [R^/Cl-'R'^)]  [n-K-l]/K,  on  K  and  n-K-1  degrees  of  freedom  was  used  to  test 

the  significance  of  each  multiple  correlation*  For  the  special  case  where  K— 1 
this  equation  is  the  same  as  referenced  in  footnote  1  above*  See  McNemar,  Q* 
Psychological  Statistics,  John  Wiley  and  Sons,  Inc*  (3rd  Edition),  P.283 

Note  3.  F  =  [Ri2-R9^)/(KTK5)]/[(l-RT^)/(n-K^-l)]  ,  on  Ki-K2.  n-K^-l  degrees  of 
freedom  was  used  to  test  the  significance  of  difference  among  (multiple) 
correlations  computed  for  each  predictor  variable.  Use  of  this  equation  to 
compare  multiple  correlations  with  the  unweighted  R  for  a  predictor  (with  K2=l) 
is  used  as  an  approximation  to  assess  significance  of  differences  between 
multiple  R  and  simple  £*  Superscripts  for  _r  and  R  which  are  the  same  for  a 
given  predictor  indicate  no  significant  difference  (£>*05).  No  tests  of 
significance  of  differences  in  _r  or  ^  across  predictors  were  performed  (e.g* 
unweighted  £s  for  Blocks  1  and  7  were  not  compared)  See  McNemar,  Q.  , 

Psychologica'l  Statistics,  John  Wiley  and  Sons,  Inc.  (3rd  Edition),  p.  284. 

Note  4.  Weights  were  estimated  by  a  computer  algorithm  utilizing  "pattern 
search."  The  funtlons  minimized  were:  l.-jvj  or  1.-  /r/*  See  C.F.  Wood 
"Recent  Developments  in  ^Direct  Search^  Techniques  Westinghouse  Research 
Laboratories,  Research  Report  62-159-522-Rl ,  31  July  1962. 
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Table  A 


Pearson  Type  CorrelaLlous  Using  Unweighliul  and  Differential  Weighted  ASVAH  Snbtest 
iJciiies  SniniMud  and  Perforinance  T lines  for  All  lasks 


ASVAli 

Ir 

1 

r  (different  weights 

we  1 gb  1 8 

1 r(dif  ferent 

weights i we  J  ght 9 

1 

Subtest 

1 (unweighted) I 
1  1 

each  soldier) 

estimated  1  encli  score) 

(K)  1 

lest i mated 
1  (K) 

1  n 

GI 

(l=6) 

1 

1 

1 

-.013 

(Ji>.05) 

(See  Note  3) 

9 

1  (See  Note 

1 

1 

3) 

1  6 

1 

1 

1  A5 

1 

1 

NO 

(1=7) 

1 

1 

1 

.059® 

(£>.05) 

.382^’ 

(£<.001) 

2A 

1  .367*’ 

1  (£<.001 ) 

1  17 

1 

1 

1611 

1 

AU 

(1=8) 

1 

i 

1 

1 

-.056 
(£>.05)  • 

(See  Note  3) 

9 

1  (See  Note 

1 

1 

3) 

1.  .  7 

1 

1  65 

1 

i 

WK 

(1=9) 

1 

1 

1 

1 

.078® 

(£>.05) 

.382*^ 

(£<.001) 

2A 

1  .359*’ 

1  (£<.001) 

1  16 

1 

1 

1611 

i 

1 

Ai< 

(1=10) 

1 

1 

1 

! 

.075® 

(£>.05) 

.382’’ 

(£<.001) 

2A 

1  .191® 

1  (£>.05) 

1  10 

1 

1611 

1 

1 

SP 

(£.=11) 

1 

1 

1 

1 

-.016 

(£>.05) 

(See  Note  3) 

9 

1  (See  Note 

1 

1 

3) 

1  7 

1 

1 

i  65 

1 

i 

MK 

(1=12) 

1 

1 

1 

1 

.080® 

(£>.05) 

.381*’ 

(£<.001) 

2A 

1  .360*’ 

1  (£<.001 ) 

1  16 

1 

1 

|611 

1 

1 

El 

(1=13) 

1 

1 

1 

1 

.056® 

(£>.05) 

-.382*’ 

(£<.001) 

i 

2A 

1  .257'^ 

1  (£<.05) 

1  16 

1 

1 

|611 

1 

1 

MC 

(l=Ht) 

1 

i 

i 

1 

.052® 

(£>.05) 

-.381*’ 

(£<.001) 

2A 

1  .363*’ 

1  (£<.001 ) 

1  15 

1 

1 

|61l 

1 

1 

GS 

(1=15) 

1 

1 

1 

1 

.053® 

(£>.05) 

-.381*’ 

(£<.01) 

2A 

1  .367*’ 

1  (£<.001 ) 

1  16 

1 

1 

|611 

1 

1 

SI 

(1=16) 

1 

1 

1 

1 

.068 

(£>.05) 

(See  Note  3) 

9 

1  (See  Note 

1 

1 

3) 

1  7 

1 

1 

1  65 

1 

1 

A I 

(1=17) 

1 

1 

1 

1 

.165 

(£>.05) 

(See  Note  3) 

9 

i  (See  Note 

1 

1 

3) 

1  8 

1 

1 

1  65 

1 

1 

PC 

(1=18) 

1 

1 

1 

1 

.176® 

(£<.025) 

(See  Note  3) 

15 

1  (See  Note 

1 

1 

1  5 

1 

1 

1 187 

1 

i 

AS 

(1=19) 

1 

1 

1 

1 

.116® 

(£>.05) 

(See  Note  3) 

15 

1  .627*’ 

1  (£<.001) 

1  9 

1 

1 

1187 

1 

1 

cs 

(1=20) 

1 

1 

1 

.162® 

(£<.05) 

(See  Note  3) 

15 

1  (See  Note 

1 

1 

3) 

1  13 

1 

1 

|187 

1 

1 

VE 

(1=21) 

I 

1 

1 

.120 

(£>.05) 

(See  Note  3) 

15 

1  .36  5*’  . 

1  (£<.001  ) 

1  7 

1 

|205 

1 

Note  1*  See  Note  1,  Table  2 
Note  2.  See  Note  2-A »  Table  3 

Note  3,  According  to  Herzberg  (1969)  tliere  shonld  be  approximately  20  observations  per 
weTgbT  estimated  to  have  reasonable  confidence  weights  obtained  are  stable;  no 
calcnlations  were  made  for  these  variables.  See  Herzberg,  P.A.  'ihe  parameters  of 
cross-val idatlon.  Psychome tri ka  Monograpli  Supplement,  1969,  No.  16. 

Note  A.  Distribution  of  scores  for  this  variable  was  narrow  (/^--lOO)  w1  tli  seven  of  the 
T^^PC^scores  being  87;  no  calculations  were  made  for  this  variable. 


Table  5 


Pearson  Type  Correlations  Using  Unweighted  and  Differential  Weighted  ASVAB  Area 
Composite  Summed  Scores  and  Performance  Time 


ASVAB 

i  r 

r  (different  weights [weights 

|r(different  weights 

1  weights 

i 

Composites 

1 (unweighted) 

each  soldier) 

1  estimated!  each  score) 

1  estimated 

1  n 

AFQT 

1 

.078® 

.258^ 

1 

1  34 

i  .235*^ 

1 

1  27 

1 

11154 

(g=22) 

1 

1 

(p<.01) 

(£<.001) 

1 

1 

1  (£<.001 ) 

1 

1 

1 

1 

CO 

1 

1 

.085® 

.257^ 

i  34 

1  .235^ 

1.  ,24 

|1154 

(g=23) 

1 

1 

(p<.005) 

(£<.001) 

1 

1 

1  (£<.001) 

1 

1 

1 

1 

FA 

1 

1 

.093® 

.256'^ 

1  34 

1  .188® 

1  23 

11154 

(g=24) 

i 

1 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.025) 

1 

1 

1 

1 

MM 

1 

1 

.092® 

.256^ 

1  34 

1  .180® 

1  24 

11154 

(g=25) 

1 

1 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.05) 

1 

1 

i 

1 

GM 

1 

1 

.094® 

.257^ 

1  34 

1  .185® 

1  25 

11154 

(i=26) 

i 

1 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.05) 

1 

1 

1 

1 

CL 

1 

1 

.088® 

.257'^ 

1  34 

1  .222^^ 

1  21 

11154 

(g=27) 

1 

1 

(£<.005 

(£<.001) 

1 

1  (£<.001) 

1 

1 

1 

1 

GT 

1 

1 

.093® 

.256^ 

1  34 

1 

1  .203^ 

1  25 

11154 

(g=28) 

1 

I 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.005) 

1 

1 

1 

1 

EL 

1 

1 

.091® 

.255^^ 

1  34 

1  .226^ 

1  24 

11154 

(£=29) 

i 

1 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.001) 

1 

1 

1 

1 

SC 

1 

1 

.091® 

.253^ 

1  34 

1  .201^ 

1  25 

ill54 

(g=30) 

1 

1 

(£<.005) 

(£<.001) 

1 

1 

1  (£<.005) 

1 

1 

1 

ST 

i 

1 

.100® 

.255^ 

1  34 

1  .183® 

1  21 

11154 

(g=31) 

1 

1 

(£<.001) 

(£<.001) 

1 

1 

1  (£<.01 ) 

1 

1 

1 

1 

OF 

I 

1 

.094® 

.254^ 

1  34 

1  .204*^ 

1  23 

11154 

(g=32) 

1 

(£<.005) 

(£<.001) 

1 

1  (£<.005) 

1 

1 

Note  1.  See  Note  1  for  Table  2 
Note  2.  See  Notes  for  Table  3 
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Correlations  Between  Multiple  Predictors  and  Performance  Time 


Multiple  predictor  models  developed  are  outlined  in  Table  6;  analyses  for 
these  models  are  summarized  in  Tables  7-11. 

Training  Achievement  Blocks  Only 

The  magnitude  of  the  multiple  predictor  correlation  involving  only 
unweighted  Block  Training  Achievement  scores  (Table  7)  was  slightly  larger  than 
correlations  obtained  with  unweighted  single  predictors  (Table  3),  about  equal 
to  those  obtained  with  score  weighted  single  predictors  (Table  3).  It  was  for 
this  set  of  predictor  variables  alone  that  more  than  one  predictor  was  entered 
into  the  multiple  R  when  differentially  weighted  summed  scores  were  used.  The 
magnitude  of  this  correlation  (Table  7)  was  slightly  larger  than  the  multiple  R 
obtained  for  the  unweighted  case  and  about  equal  to  those  obtained  by 
differential  score  weighting  for  block  training  achievement  scores  as 
individual  predictors  (Table  3). 

ASVAB  Subtests  Only 

The  magnitude  of  the  multiple  predictor  correlation  involving  only 
unweighted  ASVAB  Subtest  (Table  8)  yielded  a  correlation  generally  larger  than 
those  obtained  with  unweighted  single  predictor  Subtests  (Table  4),  but  smaller 
than  those  obtained  with  either  soldier  or  score  weighted  single  predictor 
ASVAB  Subtests  (Table  4). 

ASVAB  Composites  Only  ^ 

The  magnitude  of  the  multiple  predictor  correlation  Involving  only 
unweighted  summed  ASVAB  Composites  (Table  9)  yielded  a  correlation  slightly 
larger  than  those  obtained  with  unweighted  single  predictor  composites  (Table 
5)  but  lower  than  those  correlations  obtained  with  either  soldier  or  score 
weighting  (Table  5). 

Training  Achievement  Blocks  and  ASVAB  Subtests 

The  magnitude  of  the  multiple  predictor  correlation  involving  both  Training 
Achievement  Blocks  and  ASVAB  Subtests  (Table  10)  yielded  a  correlation:  (1) 
larger  than  either  unweighted  Training  Achievement  Block  or  ASVAB  Subtests  when 
used  as  single  predictor  variables  (Tables  3  and  4);  (2)  larger  than  multiple 
Rs  using  only  Training  Achievement  Blocks  (Table  7)  ASVAB  Subtests  (Table  8) 
as  multiple  predictors;  however,  (3)  smaller  than  that  obtained  by  differential 
score  weighting  of  most  ASVAB  Subtests  used  as  single  predictors  (Table  4);  and 
(4)  generally  larger  than  any  correlation  obtained  with  only  Training 
Achievement  Block  scores  as  single  predictors  (Table  3). 
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Table  6 


Data  Used  to  Develop  Multiple  Predictor/Performance  Time  Relationship 


Data 

1 

1  Equal  Weighting 

1 

1  Differential  Score  Weighting 

I 

Block  Training 

1 

1  Blocks  1-4 

[— 

1  Blocks  1-4 

only 

1  (See  Table  7) 

1 

1  (See  Table  7) 

1 

ASVAB 

1  NO,WK,AR,EI 

1  'no,wk,ar,ei 

Subtests 

1  MC,GS 

1  MC,GS 

only 

1  (See  Table  8) 

1 

1  (See  Table  8) 

1 

ASVAB 

1 

1  AFQT,CO,FA,MM,GM 

1 

1  AFQT,CO,FA,MM,GM, 

Scaled  Scores 

1  CL, GT, EL, SC, ST, OF 

1  CL, GT, EL, SC, ST, OF 

only 

1  (See  Table  9) 

1 

1  (See  Table  9) 

1 

Block  Training 

1 

1  Blocks  1-4 

1  — 

1  Blocks  1-4 

+ 

1  NO,WK,AR,EI 

1  N0,WK,AR,EI 

ASVAB 

1  MC,GS 

1  MC,GS  i 

Scaled  Scores 

1  (See  Table  10) 

1 

i  (See  Table  10) 

Block  Training 
+ 

ASVAB 

Scaled  Scores 


Blocks  1-4 

AFQT,CO,FA,MM,GM 
CL, GT, EL, SC, ST, OF 
(See  Table  11) 


Blocks  1-4 

AFQT,CO,FA,MM,GM, 
CL, GT, EL, SC, ST, OF 
(See  Table  11) 


Table  7 

Multiple  Predictor  Models  Involving  Equal  and  Differential  Weighting  of  Block 
Test  Training  Scores  Which  Best  Predict  System  Performance  Time 


Equal  Weighting 

Differential  Score 

Weighting 

Variable 

F  P 

Variable 

B 

F  P 

Block 

1 

.067 

2.25  <.14 

Block  1 

.005 

1.48  <.23 

Block 

2 

.146 

7.23  <.008 

Block  3 

.003 

1.04  <.31 

Block 

3 

-.116 

4.84  <.03 

Block  4 

.004 

2.92  <.09 

Block 

4 

-.082 

2.40  <.13 

Multiple 

R  =  .117 

Multiple 

R  =  -143 

Cp  =  5.00 

n  =  1359 

Cp  =  3.67 

n  =  1359 
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Table  8 


Multiple  Predictor  Models  Involving  Equal  and  Differential  Weighting  of  ASVAB 
Subtest  Scores  Which  Best  Predict  System  Performance  Time 


Equal  Weighting 

Variable  B  F  P 


NO 

-.073 

1.41 

>.10 

MK 

.353 

15.06 

<.001 

El 

-.190. 

5.32 

<.03 

MC 

-.101 

2.87 

<.10 

Multiple  R  =  . 199 
Cp  =  3.89  n  =  411 


Differential  Score  Weighting 
Variable  111 
MIC  -.008  60.84  <.001 

Multiple  R  ==  .360 
Cp  =  .98  £  =  411 


Table  9 

Multiple  Predictor  Models  Involving  Equal  and  Differential  Weighting  of  ASVAB 
Area  Composite  Scores  Which  Best  Predict  System  Performance  Time 


Equal  Weighting 

Variable  ^  Z  Z 

CO  -.183  14.80  <.001 

ST  .209  18.08  <.001 

Multiple  R  =  . 150 
Cp  =  -2.77  n  =  1154 


Differential  Score  Weighting 

Variable  ^  Z  Z 

CO  .016  67.31  <.001 

Multiple  R  -  .235 
Cp  =  .48  n  =  1154 


Table  10 

Multiple  Predictor  Models  Involving  Equal  and  Differential  Weighting  of  Block 
Test  Training  and  ASVAB  Subtest  Scores  Which  Best  Predict  System  Performance  Time 

Equal  Weighting  Differential  Score  Weighting 


Variable 

B 

F 

P 

Variable 

B 

F  P 

NO 

-.158 

6.13 

<.02 

NO 

.016 

55.87  <.001 

MK 

.245 

9.53 

<.005 

MC 

-.126 

4.42 

<.04 

Block  2 

.331 

13.25 

<.001 

Block  3 

-.307 

12.90 

<.001 

Multiple 

R  =  .246 

Multiple 

R  =  .347 

Cp  =  4.81 

n  =  411 

Cp  =  1.69 

n  =  411 
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Training  Achievement  Blocks  and  ASVAB  Composites 


The  magnitude  of  the  multiple  predictor  correlation  involving  both 
unweighted  summed  Training  Achievement  Blocks  and  ASVAB  Composites  (Table  11) 
yielded  a  correlation:  (1)  larger  than  either  unweighted  Training  Achievement 
Block  scores  (Table  3)  or  ASVAB  Composites  (Table  5)  when  used  as  single 
predictors;  and  (2)  larger  than  use  of  Training  Achievement  Blocks  alone  (Table 
7)  used  as  the  multiple  predictor  set*  This  multiple  R  (Table  11),  however, 
does  not  show  notable  improvement  over  the  multiple  R  obtained  only  from  the 
unweighted  ASVAB  Composite  set  (Table  9)-addltlon  of  Training  Achievement 
Block  scores  to  the  set  of  potential  multiple  R  predictors  is  not  particularly 
fruitful* 

Table  11 

Multiple  Predictor  Models  Involving  Equal  and  Differential  Weighting  of  ASVAB 
Area  Composite  and  Block  Test  Training  Scores  Which  Best  Predict  System 
Performance  Time 


Equal  Weighting  Differential  Score  Weighting 


Variable 

F  P 

Variable 

F  P 

sc 

-.222 

13.23  <.001 

CL 

.015 

42.99  <.001 

ST 

.299 

10.60  <.002 

Block  2 

.138 

6.10  <.02 

Block  3 

-.236 

10.40  <.002 

Multiple 

R  =  .158 

Multiple 

R  =  .190 

Cp  =  3.41 

n  =  1152 

n 

li 

1 

• 

n  =  1152 

Generally,  multiple  predictor  models  do  yield  some  Improvement  in  the 
variability  which  can  be  accounted  for  over  the  single  predictor  case  when 
independent  variable  values  are  not  weighted.  In  these  datA  it  appears  that 
the  best  relationships  which  might  be  useful  for  subsequent  development  of 
prediction  models  would  involve  differential  score  weighting  of  single 
predictor  variables.  It  is  recognized  that  while  most  of  the  obtained 
correlations  are  statistically  significant,  their  magnitude  is  probably  too  low 
to  make  predictive  model  development  profitable.  Early  in  the  planning  for 
this  effort,  scatterplots  were  produced  for  many  of  the  predictor  variables  and 
performance  time  measures.  These  plots  showed  no  clear  sign  of  curvilinear 
relationships.  Additional  data  transformation  might  improve  the  obtained 
relationships  between  performance  and  training/aptitude .  However,  it  also 
might  prove  fruitful  to  the  model  development  effort  if  a  data  base  of  item 
(ASVAB)  scores  were  available  to  permit  creation  of  tailor-made  predictor 
Composites  for  specific  systems.  Persuing  such  an  effort  for  several  systems 
of  a  given  type  might  lead  to  some  new  Composites  which  would  be  useful  for 
personnel  selection  and  assignment. 
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CONCLUSIONS 


During  1986-1987,  an  FOT&E  was  conducted  on  the  AN/TRC-170  tactical 
troposcatter  system  at  Fort  Huachuca  AZ.  Prior  to  initiating  this  evaluation, 
nineteen  critical  tasks  were  identified.  Throughout  the  test,  time  required  to 
complete  each  task  on  each  of  several  measurement  occasions  was  obtained. 
Concurrent  with  the  conduct  of  this  evaluation,  training  achievement  and  Armed 
Services  Vocational  Aptitude  Battery  (ASVAB)  data  were  obtained  for  each 
participating  system  operator.  These  data  were  used  in  a  series  of 
correlational  analyses  to  determine  what  relationship  exists  between  system 
performance  (the  criterion),  training  proficiency  and  soldier  aptitude 
(ASVAB) — the  predictors.  Analyses  included  unweighted  (Pearson)  correlations 
of  Individual  task  performance  times  with  training  proficiency  and  ASVAB 
Composites  and  Subtest  scores  as  well  as  differentially  weighted  soldier  and 
predictor  scores  for  all  tasks. 

Although  reliabilities  of  the  critical  measures  were  generally  quite  low, 
most  of  the  obtained  correlations  between  criterion  and  predictors  (except 
unweighted  correlations  involving  ASVAB  Subtests  scores)  were  statistically 
significant.  Unweighted  correlations  rarely  exceeded  .10 — never  .20.  Weighted 
correlations  involving  training  proficiency  and  system  performance  ranged  from 
.117  to  .208.  Weighted  correlations  involving  ASVAB  Composites  ranged  from 
.180  to  .258;  for  ASVAB  Subtests  the  range  was  .191  to  .427  .  Differential 

weighting  of  training  proficiency  measures  led  to  significantly  higher 
correlations  over  unweighted  correlations  in  only  two  of  ten  cases.  For  ASVAB 
Composites,  differential  weighting  led  to  significantly  larger  correlations  in 
18  of  22  cases;  for  ASVAB  Subtests  15  out  of  16  were  significantly  larger. 
Generally,  multiple  correlations  involving  training  and  aptitude  measures  did 
not  lead  to  correlations  notably  larger  then  those  obtained  by  weighting 
individual  predictor  variables. 
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APPENDIX  A 


TARGET  AUDIENCE  DEMOGRAPHIC  CHARACTERISTICS  FOR 
FOT&E  AND  NON-FOT&E  SOLDIERS 


Table  A1  below  summarizes  demographic  characteristics  of  FOT&E  and 
non-FOT&E  MOS  26Q  soldiers.  Data  presented  below  was  obtained  during  Operator 
interviews  at  completion  of  the  FOT&E. 

While  data  presented  in  Table  A1  are  no  doubt  dated,  there  is  no  reason  to 
presume  a  bias  favoring  either  the  FOT&E  or  non-FOT&E  soldiers.  Review  of  Table 
A1  indicates  that  the  FOT&E  soldiers  are  generally  lower  in  paygrade, 
significantly  younger  than  the  non— FOT&E  soldier  and  with  significantly  less 
time  in  their  MOS.  The  distribution  of  education  attained  by  these  two  groups 
is  roughly  comparable. 

Table  A1 

Demographic  Characteristics  of  FOT&E  and  Non-FOT&E  MOS  26Q  Soldiers 


FOT&E 

Non-FOT&E 

Characteristic 

n 

% 

n 

% 

Paygrade 

E*»-l 

7 

20.59 

134 

6.51 

E-2 

1 

2.94 

81 

3.94 

E-3 

19 

55.88 

318 

15.46 

E-4 

4 

11.77 

749 

36.41 

E--5 

3 

8.82 

485 

23.58 

Education 

High  School  (3  yrs) 

1 

2.94 

37 

1.80 

High  School  Grad 

31 

91.18 

1481 

72.07 

1  Year  College 

1 

2.94 

111 

5.40 

2  Years  College 

1 

2.94 

49 

2.38 

FOT&E 

Non-FOT&E 

Age  n 

X 

n  X 

34 

20.88 

2.91 

1832  24.26 

4.47 

_t=-6.63 

,df=1864,  £<.01 

(two  tailed) 

Time  in  MOS  n 

X 

SD 

n  X 

SD 

34 

28.79 

31.14 

1832  51.27 

34.96 

t=-3.72 

,df=1864,  p<.01 

(two  tailed) 
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APPENDIX  B 


APTITUDE  (ASVAB)  DIFFERENCES  BETWEEN  FOT&E  AND  NON-FOT&E  SOLDIERS 

As  with  demographic  characteristics  discussed  in  the  preceding  section, 
aptitude  differences  also  represent  a  class  of  variables  which  permit 
inferences  about  sample  representativeness.  When  evaluating  a  system,  it  is 
desirable  to  select  a  sample  which  "mirrors”  the  population  from  which  it  is 
selected  if  one  wishes  to  generalize  the  findings  to  that  population.,^  Analyses 
of  the  sort  presented  in  the  preceding  section,  and  here,  provide  a  basis  for 
assessing  whether  task  performance  attained  is  or  is  not  what  could  be  expected 
of  other  members  of  the  population.  Table  B1  below  summarizes  aptitude 
difference  of  FOT&E  and  non--F0T&E  soldiers  by  comparing  Area  Composite 
measures . 

Review  of  Table  B1  indicates  that  for  each  ASVAB  Aptitude  Area  Composite, 
FOT&E  soldiers  score  significantly  higher  than  non-FOT&E  soldiers.  These 
findings  imply  that  soldiers  selected  to  participate  in  the  FOT&E  as  Operators 
are  generally  superior  to  those  found  in  the  MOS  26Q  population.  To  the  extent 
performance  on  the  AN/TRC-170  system  is  related  to  ASVAB  aptitude,  one  would 
infer  that  test  performance  obtained  represents  a  "best  case"  condition. 


Table  B1 


ASVAB  Scaled  Scores  for  FOT&E  and  Non-FOT&E  MOS  26Q,  Soldiers’-,^ 

FOT&E  Non-FOT&E 

Area  ii  2L  SD  ^  2L  SD 

AFQT  33  65.18  20.93  2027  52.19  21.54 

_t=3.44,df=2058,  p<.01 

Combat  (CO)  33  115.48  14.30  1737  104.39  14.74 

£=4.29,df=1768,  £<.01 

Field 

Artillery  (FA)  '  33  115.12  13.52  1734  104.17  13..28 

£=4.69,df=1765,  £<.01 

Motor  Main¬ 
tenance  (MM)  33  114.21  12.35  1746  107.46  13.30 

_t=3.02,df=1777,  £<.01 

General  Main¬ 
tenance  (GM)  33  113.82  13.07  1748  105.50  13.87 

t=3.42,df=1779,  £<.01 

Clerical  (CL)  33  109.12  13.34  1747  101.10  13.19 

£=3.46,df=1778,  £<.01 

General 

Technical  (GT)  33  110.55  12.97  1875  103.90  13.86 

_t=2.73,df=1906,  £<.01 

Electronics  (EL)  33  114.42  12.42  1738  106.65  12.22 

_t=3.62,df=1769,  £<.01 

Surveillance /Com¬ 
munications  (SC)  33  111.76  13.20  1745  101.82  13.18 

_t=4.29,df=1776,  £<.01 

Skilled 

Technical  (ST)  33  114.33  12.01  1759  104.37  13.74 

_t=4.l4,df=1790,  £<.01 

Operators/ 

Food  (OF)  33  111.24  11.83  1733  104.36  14.45 

_t=2.72,df=1764,  £<,01 

Note  1.  All  Jt  tests  are  two-tailed. 

Note  2.  Special  thanks  are  extended  to  Ms  Francis  Grafton,  Data  Base 
Management  Project  Leader  in  the  Manpower  and  Personnel  Policy  Research  Group 
for  providing  demographics  and  ASVAB  aptitude  data  of  both  FOT&E  and  non-  FOT&E 
soldiers. 
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APPENDIX  C 


TEAM  COMPARABILITY  ON  TRAINING  ACHIEVEMENT  AND  APTITUDE 

Apart  from  representativeness  of  FOT&E  soldiers  to  the  entire  MOS  26Q 
population,  it  is  also  relevant  and  of  interest  to  understand  whether  any 
differences  in  training  achievement  attained  or  ASVAB  (aptitudes)  exist  among 
the  five  teams  formed  to  perform  system  set-up/operation/ tear  down  tasks  during 
the  FOT&E.  Means  and  standard  deviations  together  with  one  factor  analyses  of 
variance  addressing  differences  among  Teams  on  each  Training  Block  Score  and 
each  ASVAB  Subtest  and  Area  Composite  Score  are  presented  in  Table  Cl  below. 
Review  of  these  data  first  reveal  that  for  many  of  the  ASVAB  Subtests, 
especially,  data  were  not  available  for  many  FOT&E  soldiers.  Discussion  with 
the  Data  Base  Management  Project  Leader  at  ARI  Headquarters  indicated  that  once 
Composite  Scores  are  formed  from  Subtests,  in  many  cases  a  decision  outside  ARI 
is  made  to  purge  Subtest  scores  from  the  soldiers  file.  Given  this  limitation 
on  data  available,  it  seems  clear  that  except  for  the  MC  Subtest,  Teams  are  not 
significantly  different  in  aptitudes  captured  by  the  ASVAB.  With  this  many 
statistical  tests  performed,  it  quite  possible  that  this  obtained  difference 
was  a  chance  finding. 
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1 
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7 
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7 

63,43 
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1 
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7 
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5.52 

1 

7 

6  7.43 
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7 

B2.Bb 

9.72  1 

7 
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7 

346.29 
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7 
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7 
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7 
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4.62  1 

6 

66.33 
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— 
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Autoaotlva  Inforaation  (At) 

0 

- I 

3 

60.00 

22.91  1 

I 

75.00 

1 

2 

37.50 
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2 

60.00 

20,70  1 

f(3.4Kl  .p>.05 

Taragraph  Coaprahenaion  (PC) 

3 

64.67 

4.04  1 

3 

82.33 
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1 
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69.33 
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00.00 

14.42  j 
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Coding  Speed  (CS) 

3 

69.00 

5.57  1 
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60.00 

3.61  i 

5 

66.20 
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1 

1 
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3 

70,33 
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3 

66,67 

7.57  ) 

3 
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66.00 

6.63 
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16.92  1 

1 

43.00 

1 

2 

40.50 

U.U2  1 

2 

50.00 

14,14  1 

r(3,4Kl 

AFgT  Subteata 

Word  Knowledge  (’WK) 

3 

87.33 

9.07  1 

6 

69.33 

20.64  i 

6 

76.50 

20.18 

1 

3 

64.no 

23.64  1 

5 

77.60 

11.59  1 

r(4, 10KI  *p'».P5 

Arlttuaetic  Baaaoning  (AR) 

3 

93.67 
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7.64  1 

i 
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61.40 
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